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ABSTRACT 



This report gives an extensivfe review of the 
literature dealing with student evaluation of faculty, and 
'investigates sthe effect' of a previously unexplored variable, 
students' expectations of the teacjbing-learning situation. Eight 
student perceptions of the teaching-learning situation were 
identified: dogmatic^ erotic. Moral, ' therapeutic, intellectual, " " 
existential, humanistic, and pragmatic. The6e descriptions of student * 
perceptions were worded into statements for the students to rank on a 
five-point Likert scale, according to tl^eif perceptions of what 
teaching: an4 learning, roles mean'*. This survey. instrument was 
adminis'tered 'to classes in all four divisions at Miami-rDade Community 
College, along with questions designed to evaluate the course 
instructors, and guestiphs intended to elicit information about the 
stuidents answering the survey. Findings showed, that there was no 
si^gnif ican^t di*f ferenc^ in tie evaluation* results among students with 
dif.ferent p^ceptions of teaching and learning roles. The survey 
instrumen*t is appended, asHlSrva bibliography of literature on the 
^subject of student evaluation of faculty. (NHMO 
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^ ' ABSTRACT 

^ This project studied one variable which affects students' 
responses to teacher behavior. That variable which seemingly 'has 
not been intensive ly? studied answered the question "Do students' * ^ 
expectations of the teaching-learning situation or .student perception 
of teaching have any effect upon their responses?" 

Selecte^stateraerits that reflected the students '"perceptions 
of the learning- teacher situation were used to see if diffexences ia 
orientation or perceptions differ in student evaluation of. teacher^ \ \ 
behavior. Findings show that students' perception as associated with ^ 
(differences in student evaluation does not differ significantly f^^oict 
that which could be* attributed to mere chance fluctuations xi;ithiti f^"' " 

• " ■ ■ I •• : (^^■. 

our total population/ A review of the research finding on reliability, 

* , • ' r ' 

validity, and other aspects of student evaluation is presented. /■;; 
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' INTRdDUCTION 



Today in a time of course relevance, legislative accountability,, 
and faculty retxenchmerit , the students' are demanding a greater partici- 
patory place for themselves. The Zeitgeist is perhaps helping formulate 
such student need for a "say so" in shaping the pollege future, and at 
Miami-Dade Community College the voice. of the student is being heard. 
The student government hajs a place in the faculty ignate, there is a 
student representative on Che Board of Trustees and /now the^tudents, 
as in many colleges, wish to have their opinions felt in the area of 
faculty behavior in the classroom^ • 

The'Director of Natural Sciencies, and the. new Director of Arts 
and Sciences, have been directed to ^TddreS's their Division to *^ study of 

teacher behavior in the classroom. A larger explanation of the idea is 

\ / ■ ^ 

needed. What the new director wishres or foresees is a feedback system 

from students for teachers seeking to improve learning by student to 

teacher behavior feedback and course feedback for improving the course. 

To fulfill that directive, a committee consisting of the Chair- 
person for physics, two other professors, and myself have been charged, 
to instigate a study of student evaluation of teacher behavior in the 
classroom as a vehicle to improve learning. This will be the first 
step in succeeding steps to develop a system of student feedback on - 
teacher behavior and course evaluation. 

Th^ discussion at the first meeting entered into many aspects of 
feedback systems of student Evaluation of teachep behavior. As a result 
of .'the initial meeting, my assignment is to investigate - the common 



criticisms of stji:^dent evaluation of teacher, behavior as found in the 
literature or research^, . ^ ' 

In association with the work on this committee y it is mjr feeling 
that in the,. vast .research conc'ernigg the variables which affects stu'dent 
responses to teacher behavior, there seems to b^ one- element vjhich has 
not been intensively studied. Do students' expectations of the -teaching • 
learning situation or student .perception of teaching" have any effect 
upon their responses? T!hje specific purpose of my prafcticum will be to 
investigate this varijable and to report my -results' to the committee. 
This study of student perceptloii of teaching a«d the review of the 
literature Vill constitute my compjLete xeport to the cdmmitteci iirid my 
practicum. ^ * 

i;jiis practicum has additional college-wide significance as it' is , 
the first developing step in a program to improve learning through 
student-to-teacher feedback of teacher behavior dnd the courses. ? 



. . BACK GROUND AND SIGNFICANCE 

Teacjlin^ CDmpetence is not easily documented. The teacher is one 
*of t|je few professionals whose work is seldom observed by his peei^s. 
H,i5 testching ability is often based more on hearsay vthan .on substanti 
'evidence. For ^hls reason, promotion committees frequently make final 
tenure decisions ^without seriously cjonsidering information about teachi 
To counter^this tendency, the Organizational RevJ.ew Steering Cotranittee 
at Miami-Dade Community College recommended to the Vice-President at 
the North Campus a system of student instructional ratings and, as 
previr&usly stated. Division directors haV^ formed committees to study 
"this idea. Unfortunately, the literature wHich will be presented 

^ijpveal^ that -the faculty bave vety little more credibility^with student 

• " • ■ . . * '^^^^ 
evaluation than thev hearsay system. 

Common Criticism j * 

Elbe (1974) ijn his year stu^y of "The Recognition and Evaluation 
of .Teaching" gathdred criticisms fifom an Advisory Board consisting of 
eleven members frotn different universities . Their opinions formed from 
their research is sutnm^i?4^2ed belox^. ^ . - 



c 



I. student evaliiatiota does little general good and 
some particular harm. Faculty anxieties on this 
point are not precisely clear, for thQ same critics 
who are most dubious about general impact are often 
very sensitive to the particular harms student 
ratings can inflict. Probably evaluation has 
impact, good and bad, in relation to the degree 
it moves av7ay from the strictly private and . ^ 

personal. The effects of published evaluation 
are not so different from the effects of publish- 
ing books, speaking out in public, committing 
w oneself in any way beyond the confines of one's 
own study. 



2. ^^^tudent evaluation inay''arouse an unhealthy compe- 

tition among faculty members. 

3. Evaluation systems ntove tox\^ard harmful formaliza- 
tion, mechanization, rigidity. 

4. Student opinion questionnaires furnish inadequate or 
misleading information about teachers and teaching. 



5. 



The effect of student evaluation is a short .term one 
connected with .the novelty of the procedure. 




Students by themselves vjill not be able to sustain 
a high level of ^evaluation procedures over a 
period of time. 



Klierman (1975) lists eleven most provocative items which reflect 
faculty aJ:titude/S. The most notable are summarized belovj: 

1. 'Student evaluations are/ used v^hcn they support 

the^prior af f irmative^r negative decision of , 
the college committee or administration*. " 

2. All students and faculty int.erviev;ed by Dr. Irene 
R. Kierman indicated that beginning students cannot 
usually judge breadth or depth of a teacher's I 
knowledge of his subject. Yet, despite this, 

student ^evaluation forms ask this question. 

3. In evaluation, x^hat percentage of students should 
be discounted to compensate for those students * 
who are hostile tovjard teachers in general? 

'i 

4. Are vje not allowing students to make unsubstan- ♦ 
biated and anonynlQus charges via unsigned student 
evaluation? 

\. • ■ . 

5. How does subject matter which a teacher must 
handle affect the evaluation he receivesr? 

6. How canl we account ^f or racial, ethnic, and sfex 
bias of students in evaluating teachers? 

7. How valid are our«'Student evaluations? • ^ 
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Ten of Kierman'^ questions deal vjith ^^jSTlitical , socioiogical , *and 
p$ychological aspects of student evaluation currently in use. The last 
question concerns a legal matter, one of using invalidated tests which 
may have (the effect of discriminaJting against women and minority group 
meirjbers in mattexslof employment. Assuming that student evaluation 
fp^s in use have not been validated, they''^ not comply with Equal 
Opportunity Commission regulations^ (Higher Education Guidelines, 
^^ecutjive OTrder 11246, Page J6) * • . * 



Research Findings | 

- • ' ^ ^ 

The primajry justification for the heavy reliance on student ratings 

r 

useS'tfhe argument that *the student, as the primary consumer of the 
teaching product, is the best positioned 43erson to evaluate its worth. 

'.9 • * » 

Roden (19^)3) studies produced a -.75 corre la tiqn^ between the student- 



ratings 



evaluation and how much the student learned froift the teacher . 

.^Fre.y (1973) had some doubt about the significance of this negative 
correlation Because it involved teaching assistants # However, Prey's 
(1973) dubious attitude toward Roden was strengthened by a research 
report by Arthur Sullivan at the Memorial Udfiyersity of Newfoundland.* 
Sullivan involved ten courses of' thirty students each, i^ll classe^s 

, ■ • • . ■ ' X| ..- 

meeting at the same time. .In each class studentsVused a common syllabus 
a common text, and took d^mmon finaL^ exam. All exams were scored by 
a special committee. The results indicated a positive relationship 
(r = .3 ta a mean r = .39 for the ten cla^esjp-^etween student* ratings 
of teachers and external criteria ^f teaching performance 



Some years ago, Cohen and Brawer (1969) insisted that student' 
^ains toward achievement of specific objectives of^a course are the . 
"ultimate" criteria for evaluating effective faculty perft)rmance. 
Cronback- and- Furly (1970) ,encounter'tv[ith measurd,ng students gains as 
an index of ."good^teaching" is fraugftt with practical, and technical 
difficulties* • ' " ' . v V . 

Two 5tu(}ieVs were complet-ed at Purdue. University comparing the 
amount learned from chemistry instr^ct^s with student :rat;ings of the 
instructors. The m£iterial covered and the grtding p/rocedure were more 
,03? less standardized. An effort was made to cotrect 'for tfie. effect of 
difference ^between classes in initial ability. In both of these J ' 
.Studies, a lo^ positive correlation was obtained between, hoW' a class 
rated the instructor and tiio,w, much material they had learned (about +.24) . 

■-.*■•■•■ ^ 

Roden (1973) in his articles^ concluded that '^'if hoy? much ^students \ 

« «» 

learn is ^considered to be a major component of good teaching, it must - 

'■ . ' ■ • <. *■ - ■ • • 

be concluded that good teaching is. not validly measured by student 
evaluation In their cttirent form." - \ . 

Effectiveness ; .of Student Feedback . Centra (1972) undertook a study in 

1971-72 with five different type colleges, to test if feedback to teachers 

# ■ ' "■ ■ , . ^ / 

from student evaluation would improve teaching. This very extensive 

research divided teacher^ into three testing groups, of feedback, no 

feedback, arid a. Gon£:^ol/ group. The results proved no significant 

changes among them. Included in the student ratings were items that 

facultymqjibers in an earlier study had identified as information they 



they wouid like to obtain from students (Centra 1972 ). The surprising 
results wete that nealpft^^ all three groups Wiire nealrly identical in their 
scores, an indication that the group of instructors^who received student' 
feedback did not noticeably modifyVtheir Jteachinig prac^ces* However, 
afteij the research was extended, the time factor did produce a change; 
but individual counseling also he^lped. Centra commented, "The changes^ 
were by no means overwhelming, but it does support the utility of 
student ^ratings for^ instruQtional improvement." However, the evidence 
is very* meager and not of a magnitude to encourage using student e.val- 
uation unless an extensive counseling ayjstein or what some may label 
"watch, dog system" is utilized to promote improvement. Eble (1971) 
suggests making the ratj.ngs public and this would bring better results. 

Teacher jCharacteristics . Brawer (1968) reviewed studies of the personality 
characteristics of college and university faculty and found that the' 

• ' *: . 

studies were "few and inconclusive." Cohen and Brawer (1969), studying 
the characteristics that a successful teacher^ould possess, discovered 
that the teacher's characteristics are highly diverse.' Research finixngsi 
to date have not been especially fruitful. ' 

Reliability * Frey (1973) demonstrated that students can agree about ^ 
the strength and weaknesses of different teachers. Cos tin, Greenough 
and Menges (1971) agree that students can fate classroom instruction 
with a degree of reliability. This conclusion was reached after 
extensive review 6f the findings concerning reliability. It must be 
stated that these studies were at a correlation of .2 to .3 in many areas% 



Validity ^ Even though students are the only people who obsef^e a 
teacher's course daily^ many faculty seriously question the validity 
of students' instructional ratings."* Sonle faculty' claim to teach philo- 
sophical values or to inculcate a special attitude toward learning 
ratjier than- simply help students to master the subject matter, The^e 
goals are difficult to measure and, therefore, it is difficult to 
determine whether teachers who successfully/ accomplish these goals 
are also the ones who are rated highly by their students. (j^^' 

Many researches can be listed which might culminate into validity 
of student rating under some' criteria headings such as: 

^ 1, Consumer Satisfaction and Course Objectives . McKeachie (1969 ) 
•found that students who performed particularly well on 
the test rated their teachers as "mord effective" than 
idid, students who petrforraed 'fJiore pOorly on the test^ 
McKeachie, Lin and Mann (1971 ) reported simila'r findings 
and students who rated teachers high on "rapport" (i.e., 
warmth) tended to be effective on measures of students' 
"critical thinking." Lathrop and Richmond (1967) found 
positive correlation between high ratings and the extent 
to. which students thought they had achieved course 
objectives . " . ' 

2. Students ' Criteria of Effective Teaching ., Crawford and 

*\5radshaw (1^68) asked students to describe the most* effective , 
tfeacher they had ever had. »The most frequent characteristics 



were: (a), knowledge of subject (b) planned and organized 
lecture (c) interest in teaching (d) warmth toward students. 
French (1957) had a similar, test as did^ Elliott (1950), Mann 
(1^50), and McKeachie (ig69b) 

Another .point of ^interest is to relate students* ratings to 
the degree of teachers' experience? or training. Walker 
(1969) found that students' ratings tended tb improve 
with the experience of the faculty member. A full^ 
professor tended alao to receive higher student rating 

than did other r^anks (Downie 1952) / especially on certa-in. 

\ ^ ■ r ' 

items as sense of humor, presentation, ^and interest. , 

' ^ ' . . ■ . -, 

SexV Major > and other Variables . Costein (1971) implies to ^s that 

sex does enter tnto student evaluation* ^' 

' 1. In four of the five studies teaiA^s-rated high on 
'*Skill" tended to be effective with women* students* 

2. 'In all five studies'" teacher^ rated high in "Structure" 
tended to be more effectiv^. with women thafi with men. 
In fa-ct, on the whole, the more structured instructors 
tend to be ineffective for "male students. 

3^ Teachers who were high i*n "Rapport'!, ("warmth") tended ^ 
to be effective pn measulres of student thinking. 

4. * Teachers whom students rated as having an impact on 
beliefs were effective in chafing attitudes. 

Majors in psychology were found to rate courses and instructors 

about the same as non-majors. However, students re qtfired to take a 

psychology course tended to rate it lower than did students who selected 

course (Cohen and Humphreys 1960). Other investigators found' (Gage 1961^ 

Lovell and Hgner 1955) that teachers of required courses 



■ ■ ■ ■ ^ i :■ ■ ■ ' . 

received significantry lower student .ratings than did teachers of 

" ■ " .[ ■ ^ ■ ■'■ ■ ■ .. • . 

elective courses, * • 

Non-jproponents of students V ratings frequently suggest that 
teachers or large classes n^ay receive lower ratings ^because students 
prefer m6re interaction which occurs in smaller claslses. The list of 
investigators that support t'his is extremely llong. The most recent 
investigatidn of this bjelief is McDariiel an^^eldhus^n, 1970> ' 

Another argument about the validity of studlent rating Is that 

* - " > \ ' 1 ■ • ' " -''.!''. 

students tnay judge .ins trufct ion oti the basis of /its "popularity'^ 

\ i ' ■"'*•'■!■■■. ' ■ ' ■ 

value. GuthrpLe (195^) concluded that "Popularity" djE a teacher -may 

'[ / ' • f ■ , ' 

well be an \ index of "good and substant^.al" teaching r.^and students' 

ratings may re\f lectin both, * ^ 



Student Perception and Value Systems . In the concluding discussion of 

a research l|y ]M[cKeachie, Lin, and Mann (1971), 'the fallowing proposition 

was concluded: , 

'So student ratings have some usefulness. Why ajceu't 
they better? Our best guess is that the major slippage 
in our validity studies is in the differing goals, of 
. * teachers and students. Students come to a class with 

many different personal objectives for that class. Some 
^ of these objectives may coincide with those of the 

instructor, but the overlap between instructor and; ^ . 
student goals or between the goals of differing students 
is certainly far frqm perfect. The extent to which 
a our tests measure achievement of these goals is also 

- limited. Thus, even if each st:uden^t's rating of the 
, tnstructp,r- s effectiveness in helping that student 
athieye.his own goals were perfectly valid, we would 
fiiajd^ow* validity coefficients in studies such as thisj 
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Frey.X1974) had this to say: 



si 



Thirdly,.! believe that- it is important to take into 
account the fact that student's perceptions are a product 
of their own personalities as well as of the teacher's 
behavior. Thus the Impression that a teacher creates 
depends not only pn hi^ own behavior but also on the 
behavior and expectations of his iaudience. Any analysis 
T7hich assumes that teachei: ratings are independent of 
their source will be .woefully inadequate. 

Evaluation for each individual, be he student, faculty^ 
^ or administrator , consists of taking what the teacher 

said and did and considering these factors in tierms -of 
one's own value system and educatiatial philosophy. 
Certainly, one student may value^one^aspect of tjhie 
course more, than a second student would. These con- 
siderations^imply that any overall rating that a student 
/ t n^akes will reflect two different types af factors ;;the 

events whdch the student observed during the course And 
his evaluation of these events within his own value ' 
c system, * * . 

, Frey (1974) using the term "in his own value system" is getting 

. ■-- - ^ . .... ■ . r 

very close to my agreement -with Epperson's (1974) orientations or 

expectations \toward the teaching-learning situation. McKeachie's 

"goals of the students" is more looselj^ interpreted as perceptions, 

but goals are effected by our '^lue system and goais, value 

systems and perceptions are ^11 interrelated in the to'^tal complex 

being, ' 

Frey and McKeachie are relating .to my r-esearch that student 

perception, which is part of the student's valu§ system, may have 

effects on the responses to student evaluation. Frey, in his 

discussion, suggested that students can provide teacher evaluation /-- 




'structed with a|ppro|^iate questions that are unco^ltaminated by students 



value system. Frey is presently developing such a form. 

V . r . 

Committee Report , -because of sickness of Comraittiee members the final 

... ' ■ i ' 

report was not completed. This resulted in myself being* selected to* 

supnarize what materials the membefs had in their possession. The ^ 

summary is in Appendix A, * ^ ' - 

PROQEDURE 

David C. Epp^,^son in his article, "Assessing Altej>fiat;ive Teaching- 
Learning Alliances" in L. J. Stiles, E'd., Theories of Teaching . (New 
Yjbrk: Dodd, Mead and Co., 1974) Ch. 5., Igu^fests students may have at 
least eight orientatibns or expectations toward the teaching^^eaming 
situation. He listed these as: 



1# Dogmatic 



2/ Erotic - 



3. , Woral 



The teacher is an authority in his field 
and teaches the coursB with little room 
for differences of opinion. 
The teacher's role is to develop a climate * 
in which the student may .excess his 
inner feelings and clarify them to himself. 
The teacher's major role is to point out 
the gap between what ought to be done in 
today's society about social problems and 
what is being done about them. Hopefully, 
the student, will be motivated to actively 
participate in the- problem-solving activities 



i 



4. 



5, 



6. 



7. 



8. 



Therapeutic - 



Intellectual - 
Existential - 



Humanistic - 



Pragmatic - 



The t(tacher's rcl^ is to help the student 
resolve the cbn^llcts^in society, suqh as 
justice vs. i^just^ce;. equality vs, 
ine<tvality. 

The course tack^^les tiyugh, complex i'ntell- 
^ ^ ectual problems i 

The student is happiest in courses in 
which he fjLnds direction and purpose for 
his^ life. 

Classes in which the student's uniqueness 
and individuality *are highlighted are 
n^ost helpfulC 

Those courses in which practlcetj, saleable 
skills are developed are nnost enjoyable"" 
, to the students. " , 



Eppersjon's descrijption of these pierceptions x^ere x^orded into ^ 
statements for t^e student to rank on a Likert .scale which accurately 
reflects his concept of what teacliing. and learning Toles mean. 'V 

The developed instrument that was used in this practicum is in 

A-pp^ndix B attached. The statements for Epperson's descripticjns were 

developed and reviewed by an expertise group. Three statements for 

each of the Eppers6ti descriptions were developed. Then my expertise 

group of four faculty members selected that statement which they ^^n- 

sidered to best fit the description.. The expertise group consisted 

" The reader ^ust read' the direqtiona given to the student.- TheWudetit ^ 
only selected one best teaching perceijtion with the rank of "strongly a^re 
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-of one English teacher, one from testing, one from phys^.cs, arid one ' 
ftq^ the- faculty development 3 i vis ion. Suggested revisions «were reviJw^d ' 
and the selected statements were finalj^zed^ My selected statements 

I* i 

^hus reflect t*he -descriptions of Epperson as Judged by my §^pertise \ 
gr^p. These eight orientations or expectations to\jard the learning* ^ 
teacher s^ituation will be evaluarted to 'see if 'dif ferefices in orentiation 
or expectations are associated with differences in student evaluation 
of teacher behavior.' ^ ' • 

The evaluation form will be composed of three 'parts: 
Pa^ I: Perception af Teaching Statements 



Part II: 
Part III> 



Teacher Behaviqr Evaluation 



.Control Data 



^ Part I Xi7as prepared by me and revijs^ed by a board of expertise 

composed of four faculty members. Part H >»as coord^.nated vith Organ- 

• ■ • » 

l^ation Review Steering Committee* and the Researelt and Testing Depart- 
ment. The pRSC had intifoduced student ^evaluation as a discussion subject^ 
at a. recent workshop far some fifty faculty members » From^ that workshop 
was develJoped a pilot evaluation form. After some^eview and discussion 
with Or . /jx)hn Losak, MDCC, ank Dir. Johfi Alteman of iTIU, my decision was 
to use the ^Wd^nt Evaluation of the Teaching of MiamtrDade Course 
'Form developed absMiami-Dade north. This evaluation form is an instru- 
ment which has been used for a number of years. Part III includes 
additional inforniation which -may be utilized for other significant 
results. Discussions of the control- data were also conducted with 
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the -above mentioned individuals and members of the committee and faculty. 

Correspondence has been initia,ted "vJith Inter-institutional Research 
Council of Florida. Community* Colleges and SIR, the Student 'InstructionalN 
Report, .of the Educational Testing Service of New. Jersey. They have 
numerous studies and systems which need the committee's attention. 

Population. The population to'' which the study is intended is the student 
body ^t Hiami-Dade Community College (North) # SinJe'' the North Campus is 
divided into four, divisions, my idea was to randomly select some teachers 
from each of the four divisions. This selection from a cross section 
of four divisLons was* intended to give a sample^ more, adequate than 
random selection from the total faculty because randomized selection ^ 
of teachers might result' in selecticm of- the entire sample from the 
sdme. division. Once the teachers had been selected ' they would, by 
random choice of classes, administer the "questionnaire to the students. 

The teachers in the four divisions were numbered for utilization 
in an APL ptogram. The API terminal has a random generator w^ich will 
select as many numbers randomly from a range which the operator sets 
in tlie program. This. range was the number of teachers in each division. 
Thus, the program randomly selected two teachers from each division, 
A similar system was used by the teachers to se^^ect a class. Howfeverj 
most teachers in th^ summer session have only txsjo classes, so selection 
was simplified. ^ 

Procedure for Treating Data . Because of the dichotomous results in" 
the frequencies of the first eight questions,, a reclassification was 



22 



necessary, ^he eight questions werfe combing into Sbur groupSf on the 
ibiisis of similarity and relative 

4 . 



Group 1 
(Question 1) 



ifnal Term 



hori^tfve t^^acher 



■ i 

i 



Group 2 

(Quesfcion 2 & 7) 



Group 3 

(Que^ions 3,4,5) 



Group 4 

(QtM5§ti<ins 6,8) 



i 

^tudent-Centot teacher - 
A\teacheT' whigf sees the student's 
.uniqueness ai^td helps hijn express 
'his inner fqelir^gs. ^ 



Social Conscious Teacher - 
A teachei^ who sees social problems 
and promotes intellectual social 
problem solving,* ^ ' ^ 



J" 



Career Counselor * Teatfher 



Teacher who gives purpose to^studeht^s 
life and tei ' 
livelihopd.c 



life and teaches practical skiils for 



After, classifying ttie questions into groups, [item$ (9) through 
(32) were summated for each of the four groups. That ipiumber Vras 
run as a parameter measure on an analysis of variance for the group. 



Hypothesis: 



Null Hypothesis: 



The four types of perceptioids as 

^catalogued in each of the groups do 

have* signfibantly different ratings 

fox the teachers. 
\ 

The four typeNs do not have sigtx^ickntly 

different ratings f6r the teachers. 



The data was treated with various computer programs. A multi- 
variate Analysis of Variance distribute^ by Clyde Computing Service, 
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Box 166, Coconut Grove Station, Miami, Florida, 33133, was utilized. 
Also used was a i^r^granuon internal reliability computed to produce ^ 
Cronback's Coefficient a. A chi square was also .run on items (9) 
*thraugl^ (32). 

Limitation. The time limitation of completing this study, of course, 
produced some difficulties. As data was being collected th^ frequ^^cy 
distribution' of the first eight questions were^ apt realized until » 
primary runs were made on the- computer . An attempt to acquire a 
larger sample for better distribution was blocked due to the semester 
ending. The teachers, during the close of, the final weeks of the 
slintn^r session, were reluctant to take the forty minutes to complete 
^the questionnaire in their clashes, plus the Eact fel^at the ^students' 
attitudes a^ the end of a six week session are not favorable.* However, 
tlie similarities of the groups formed are very good and allowed for 

-» . 

^ ' ' - ■ ■ : 

a much stronger statistical instrument , an analysis "of 'Variance , to 

be used. (The sample was* compiled in the wintef* semester .) 

\ . ■ 

" ^ ^ PSULTS 

• ■; \ ■ .■ ■ ' ■ . • 

Characteristics of the Population . Question 33 to 44 were Part 11% of 

the questionnaire. These questions provided more infotmation on 4 

description of the sample. Fifty-five percent of the st,udents claime^S 

a cumulative grade point average o^^ 3 through 4, and . thirtyr^six percent "^"^ 

■ - -.. 

' ■ ■ - ^ . ' 0 

from a 2 to* a, 2.99. VTh'irty-six pe'rcent ^were earning an *'A" in the, " 

coiirse arid seventy percent liked the subject they were presently t^aking. 
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- A. 

Although school policy frovms upon. working full time and going to school 

full time, a majority of the students do not keep this policy. Fifty- - 

nine percent of the sample, were' taking a,t least fifteen semester hours * 

of classes and fifty-eight pifercent were -forking more than twenty five hours/week* 

Thirty five percent were emplayed more than thirty five hours. A more 

complete summary is given in Appe^l^x C. ; ' 

Significance of Data 



Analysis of Variance. The analysis of variance on scaled scores had one 

' . . . ■ • \ • V . ■■ ■ ■ 

factor and one variable i but at four levels^ Factor G as used in the 
table following are the fotir groups. 

■ 1 ' ■ 

Table 1. Means and Standard De3/iations , 



} 1 



Factor 


Number 




Score 


G 










57 


1 








M 


47.211 






SD^ 


15.922 


2 


36 










M 


43.028 






SD 


15. 585' 


3 . 


19 










M 


45.211 






SD 


14.497 


4. 


36 






« 




M 


50.500 ^ 


_ ^ , 




SD 


17.928 



*The analysis of variance of the four groups and the scale^ score's 
generated the following results: • 
Table 2, Analysis of Variance ^ 
Source SS DF - MS F F less than 



Within cells 
G 



37730.582 
1062.120 



144 
3. 



262.018 
354; 040 



351 



0.260 
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According to* the de sign of the ^bove run (Edwards, 1972; the /Ji value 
at a 0.260 level was not significant • Usually this tesult is considered 
too small a .p value tol be significant. Consequently, the above results 
do not allow us to reject our null hypothesis; that is, the measurable ^ 
differences which were found to occur in the differences in perception 
of teaching ais associated with differences in studet)tt evalu!ation of 
teachers could be attributed largely to mere chaxlTce fluctuations within 
bur total population* The -actual values were: 47.211 + 15,922, Group I; 
43.028 + 15.585, Group' II; 45.211 + 14.497, Group IH; and 50.500^ + 
17.928 for Group IV. / 

Internal Reliability .. The internal jreliability computed from ANO\^ wds 
run on questions (9) through (32) for each of the groups.' That run 
provided .909 internal reliability f^r Group I, 0.934 for Group II, * < 
1905 fo^roup III, and .941 ^^dft Gtoup IV* Thus, the internal telia^^ 
by grouW was at an acceptable level. 

' CONCLUSIONS AND RECOMMENDATIONS 

It Would appear on the basis of the research reviewed that an 
instructional rating system wheh.^ properly developed can proV'ide reliable 
and valid information about teachiitg- Research findings suggest that 
the criteria used by students in their ratings of instructors had much 
more to do with course objectives -and consumer satisfaction thatt with 

entertainment value. Such attributes as preparedness, .clarify,' and 

* * ■' 

stimulating of students- intellectual curiosity were t;j^ically mentioned 




^by students in describing their best instructor. Correlation for 

". . . .. •• • ..' ^ • . h 

personality characteristics were not fruitful except for the repeating 

o ■ ■ • ■ ' ■ ' - • ' 

characteristic that continued to appear in the research — the character- 
istlc of .warmth toward students. Other correlations of student ratiftgs * ' 
which wer -noted ; "majors" tended to rate courses m^re |iighly than 
"non-Tw^^jors" in some cases; students required to take a course sometimes 
rated it lower than those for whom it was an* eleVtiye; atld Experience 
•and higher ranking instructors usually received, higher ratings than did 
their less ranked or experienced colleagues. There was also some Evidence 
that feedback in the form of student ratings maj^ improve the teacher's 
performance. And last, but not least, the value system or perception* 
of teaching a student has may influence the evaluation^ 

The results of this research confirms that the null-hypothesis 
may not be rejected in the population we studied herein. That is, 
students perception as associated with differehces in student evaluation 
does not differ significantly from that which could be attributed to . 
mere chance f luctuations Within our total populafciont^^ecause of the . , 
nearness of the end of the semester the resulting^frouping may have 
'weakened the instrument design of the selection of the course expectation. 
However, on a forced response of just the form groups, little diffierence in 
frequency distribution woyld probablyhave been observed if originally 
written in this fashion. This research vindicates that further study would 
have to be^done along the lines of students' perception influencing ^ - 
evaluation* Also, it is revealed here that students in the sample are 
oriented toward practical aspects of education as^ indicated by the number 
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wh«/picked group ^our. The autfioyitative teacher still is preferred 

■ If an evaiuatioti system is to be adopted, it is recommended that^'a^ 
form which attempts to eliminate the students' value sy'stem be adopted. 
Frey (1974) claims to have this developed. If an evaluation system is 
to be adopted, it should be stressed that means or normals of different 
courses be kept for courses which are considered to be inore difficult 
Research indicated this is a preferred methodV This helps to answer the 
questio'ns "Which teachers are most effective^' and "For which objectives?" 
With such additional specification,, student evaluation may provide useful 
evidencfe. of teaching effectiveness. 

"What is to be done?" This answer is discussed in Appendix A. 
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APPENDIX A ' 



.. SHOULD A STUDENT EVALUATION OF TEACHING BE 

ADOPTED IN THE COMMUNITY COLLEGE? . ' ' ■ 

My main concern is to present rationales that will assure faculty 

that student evaluation would be an effective instrument to adopt at . 

their college'. A logical approach, is to answer or discuss the objections 

which faculty have^ presented to me in the literature and research, and 

associBes ftinu different, universitier a them.with my comments^ 

I • The effectiveness of instruction ; cajirio1^ < bfe' tj^itcfe oyears " * . ,J 

after the fact * * ' 

The professor who is hated in undergraduate days^yet reyered in 

middle life "a^the, best damn teacher I had" has become trite. Although 

more study is needed,, there is evidence that evaluations of teachers 

y ' ■ ' . ' - ■ - 

"change little with tijne. Drucker and Remraers (1951) -give evidence and 

more recently Centra (1974X provided even great^ proof that there ia no 

significant difference in student and alumni ratings*-. 

2. Student evaluation of teaching is an invasion of academic freedom. 

Academic^ freedom, as interpreted by most voters today, should 

not be interpreted as granting a professor iinnunity from orderly and 

responsible appraisal of his competence in So major an area of his 

professional activity as teaching* The judgement of academic performance 

by professional standards does not constitute interference with free 

inquiry and expression. Indeed, it may yell be that responsible evalu.- 

ation by professional standards of our dejvising is the only way that 

:we can protect ourselves from more sta.te or federal interference or 

influence. " ^ ' 
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3. The regular use of student evaluation of teachinfe would 
constitute a very big change in academic procedures some 
colleagues estate * . j ■. 
Thi^ tnay be true that many would view the student evajuati|n 

as a big change* They h^ve lived with the present system and have survived 
within it. Any change is seen as a threat by some of them* ^ Another view 
is that the changes would only help us to do better what we already are 
trying to do*-- give recognition to quality of instruction when recommending 
promotion and merit increases and hence, it Would not be such a big 
chartge. iio sudden Jbig change needs^ to happen. Prudence might counsel 

Starting with a pilot project involving selected, departments. 

* .' <* ■ , 

4. How can we account for racial > ethnica and sex biases of 
Students in evaluating teachers ? 

• . ■ . 

This problem may become more acute if the Civil Rights Act is 

- . • , ■ ^ ' . 

successful in placing women and other minority group members in high 

■ ■ ..• - 

prestige positions if they are not qualified. Many students find women 

*' " *i* *■ 

and minority groups a threat and may find it difficult to evaluate them. 

The only scholar who has entered, into thought, on this problem is A. T. Sharon 

■ . ' ■ " . ' . ■ . ■ • - f 

(1970). He feels that in the structure of the evaluation you. can eliminate 

some bias. * . • V /; 

5 * ' The most recent article to ignite thought is Irene R» Kerman's 

; "Student Evaluation Re-evaluated (1975)*' > 

Kierman stated that: ... * 

Student evaluation o£ faculty^ falls under the 
* . ' ^ definition of "test" as defined by the American . 
. and Psychological Association and Equal Employ-, 
ment Opportunities Commission Guidelines concerning 
appointment, reappointments, and^promotxbn of faculty 
members* ' . , 
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Kierman claims the 



especially fou minority 
use . * • 



teacher evaluation tests h'ave not been ^validated 
groups • Thus she claims they can challenge thpir 



This is not true, M^ny studies as McKeachie (1971) and Costin. (1971). 



have developed valid' testing procedures. The Educational' Testing Service 
pf New Jersey has developed a system called ^SIR", Student Instructional 
Report-. , * 

^ Regularized ratings of teaching would constitute another 
instance of" the dehumanizing of people by describing them 
t^ith numbers > a trend which is deplored b^> students # 
Such numbers, like many others, ^are not primary sources of 
dehuraanizatipn. Numbers' are merely^ symptoms of the estrangement that comes 
with too ma'ny people. . Stamping out numbers will not cure the malady 
deplored by students. At a college where ten professors teach one hundred 
students, numerical ratings of teaching are not use fulj everyone carries 
fifufficient evaluatipn in his head. But, at a large university, it is mot'e 
dehumanizing to fail to recognifeie and reward effective teaching adequately. 
7. Prior ratings would prejudice subsequent evaluations » ' 

fhis is called- the "halo effect." If ratings are not published, ^ 

■ . * . . ■- 

this is not a co^isideration. Hal effect is not a serious threat. Professors 

make great show of their research or national recognition to committees,^ why 

not include student ratings. Besides, professors are a frequent topic of 

conversation among students and they are continually being rated. 

. I do not fancy my brief comments have disposed of the above arguments 

against student evaluation of teaching* Some of the objections are well 
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taken, and the entijrq subjeet of evaluation presents^ complex pattern of 
considerations combining white, black, and shades of gray. I do believe, 

. . - ^ . ■ - V • ^ . ^ . 

however^ -that the weight of reasoned evidence justifies giving student 
' evaluation of teaching a thorough trial. 

What is to be done? I believe it is -desirable to: (1) establish a \ 
regular use of student evaluation of teaching for the benefit of the 
instructors, students i and advancement procedures; (2) g^in the cooperation 
of the eiitire faculty to secure the ratings and establi^ the purposes,, 
objectives, and uses; (3) norms be calculated and a counselor be established 
. to interpret the results if^requested ; (4) student -evaluation of teaching 
be used to supplement, but not substitute for other valid kinds of evalua- 
tion. Similar conclusions have been reached by xnahy -persons who have 
studied the evaluatiopi of teaching as Kenneth E. Eble, Director of the 
Project to Improve College Teaching, (Eble, 197{f) 

Numerous problems remain on which informed^^and reasonable persons 
have differing opinions: How will the procedures adopted give the desired 
^emphasis to' the two primary objectives of: (:|) contributing Indirectly to 
'^the betterment of teaching by improving the e\)Q>ulati6n of teaching; and 
(2) contributing directly to the betterment of ^teaching by helping individual 
insttiictors to improve. Surely the academic communitj^ could find adequate 
solution to these problems so that a flexible program Ipu Id be initiated. 
This is, it could if it would — and I am conficent tl|?j||^ time it will, 
as Soon as leadership appears • 
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STUDENT EVALUATION OP THE TEACHING OF MIAMI-DADE COURSES * 

The purpose d£ this evaluation form Id to furnish a basis for the contlni^ous 
improvement of instruction. When these evaluation forms kre used at the end of 
this term, they will not be looked at by the instructor until final grades have >een 
filed. Your response is anonymous. DO NOT FILL IN YOUR NAME. After you have 
con5)leted the 44 questions, hand in your answer card and questions. Mark yottr 
choice of answers on the card provided. After you have read ALL of , the eight 
following questions, pick out the ONE statement which MOST ACCURATELY reflects 
your concept of what teaching and learning n^an, and mark the (1) STRONGLY - 
AGREE space on your IBM card. Use the number "1" space ONLY ONE TIME for the 
first eight statements* "Proceed to rank the remainder (7 questions) between 
choices "2" and "5*'. For the first eight questions use the following scale: 
DO NOT MITE ON THIS FORM . 

1. Strongly agree : *• 

2* * Agree 

3. Not sure whether I agree or disagree 

4. Disa^ee . , 
5# Strongly disagree 

1. I Ift^e a teacher best who knows his field and authoritatively declares 
that information to the class. 

2. I like a teacher best who develops a climate^ in which *I may express my 
inner feelings and^c^arify tliem to myself. ■ 

3. I like a teacher who motivates problem-*solving activities by pointing out 
the gap between what ought to be done in today's society about social 
problems and what is being done about them.^ 

4. 1„ like a teacher who helps individuals resolve the conflicts in society, for 
exanqple. Justice versus injustice, equality versus inequality. 

5. I like a teacher who helps me solve tough, conq[>lex intellectual problems. 

6. I like a teacher whose course gives me direction and purpose for my life. 

7. I like a teacher whose classeir^ emphasise the student *s uniqueness and 
individuality. 

8. I like a teacher 'whose priory purpose is to teach me skills I can 
utilize in earning a living. ' 

MARK THE SCALE PROVIDBS) ON m REMAINDER OF THE QUESTIONS . 

^ 1 , 2 3 4 5 

Excellent Fair Very Poor 

■ ^ . . ■ ■■ . . ■ •■ ^ ■ 

9. How do you 

rate him(her) . • % ' 

as a teacher? . . " . ' * 



10 # How is his 
knowledge 
of his subject? 



JIow ia the 
organisation of 
hls>|:ourse? 



Bxcollent 



Arc hl.3 explanatiocd^ 
in class clear? 



How are his 
assignments: 



Always 



Clear 



4 



Fair 



Usually 



Usuiilly 
clear 



Very Poor 



Seldom * 



Confusing 
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How enthusiastic is 
he in class? 



Very 



iloi^ is his ability to 
express hid 
thoughts; 



Excellent 



Hqw is his sense of 
stressing important 
matters? 



Excellent 



How is his ability 
to stick to the^ 
subject? 



Always sticks 
to subject 



Is opportunity given 
for students to 
participate in 
class? 



Often 



How is his 
ability to 
inspire pupils? 



Excellent 



How imxch does he 
encourage the student 
to think for himself? 



A great 
. deal 



Usually 



Usually has 
no difficulty 



nit. 



narely , 
« digmsses 



Ocoasiooally 



Fair 



Some 



Lacks enthusiastic^ 



lias a great deal 
of difficulty 



if 

9 V 



Very poor 



Gets completely 
off subject' % 



Rarely 



Very poor 



1^ 



Not at all 



How are^iis tests as 
to coverage of 
material? 



Ve^y 

tecsonable 



. Usually ^ 
reasonable' 



Unreasonable 
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23^ How is bis grading 
a« to falracssT. 



Very fair 



fair ^ 



V«ry unfair ' 



23. What Is his attitude 
tovard difference of 
opinions on controvcraial 
' questions? 



Very 
tolerant 



Fairly 
tolerant 



Very 

Intolerant 



24. How is his .attitude 
as an instructor 
toward student? 



VcVy under- 
standing & 
patient 



Ucually 
patient & 
responsive 



Impatient & 
Indlfferant 



25* 



26. 



How is his sense 
of humor? 



How often have you 
seen choating In 
his class? 



Exceptionally 
good 



Nevex^ 



Fair 



Somatimes 



Vei^ little 



Very often 



27. flow is his. personal 
appearance? 



Very neat 



Usually neat 



Very careless 



23. 



29. 



How are his class- 
room manners? 



^Very 
courteous 

How is his speech? 



Easily 
understood & 
pleasant 



Usually 
courteous 



Sometimes 
inaudible & 
indistinct 



Very discourteous 



Very difficult 
to listen to 




31. 



How about his 
mannerisms? 



Overall rating of 
course . 



Usually 
attractive 
classroom manners 



An outstnndiag 
course 



Moderately free 
vfrom distracting 
mannerlsmi 




A reasonably 
good courle 



Frequent annoying 
mannerisms 



A very poor course j 
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32. If given the opportunity 

I would tal;c andthth course 
x^tth thiii instructor'. 

Ye* 



M.yb« 
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Ho 



29 

Fage 4 

33 • Your cumulative grade point avorase Is; 

!• 3*0 through 4.0 2# 2 #0 through 2.99 1*0 through 1.99 

4. 0.99. or less 

34. 4ie grade you arq presently earning in this course i&: 
U A 2. B 3. C 4. D 5. I? 

35. ' If employed > how many hours per week? 

1» less than 16 16 throuj^ 24 . ^3« 25 through 34 

4. 35 through 40 5. over 40 . » 

36^ "How many' credit hours are your presently taking? ♦ 
Under 12 2. 12 through 15 3. 16 through 18 4. Over 18 

27. Sec: I. Female 2. Male . * 

38. IThy are you taking this course; « 

!• A rciulrement for your inajor* 2# An elective for your major 

3. A requiremant outside your major ' 4. An elective outside your major. 

39. To what extent have you applied yourself In this course^? 

!• To the maximum 2» Very much 3. Average 4. Very little 
5* Not at all \v 

40. Do you like this subject? 
1. Yos 2. No 

> - " 

41* Do you feci you had enough background to take this course? 

!• Yea 2. No ^ 

42* Do you attend class regularly? 
I. Yes 2. No 

43. Are you: ' 

1« Black American' 2* White American other than (3) 3. Spanish surpamed 

4. Foreign student other than (3). 5. Other . ^ 

/j4. This course Is a course In: 

1. Science or Math 2« Social Science 3. English or Language 
4. Other technical fields (TVS) 5. Other , 
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33. Y6ur cumulative grada point average is: 

1. 3.0 through 4.0 (557o) 2. 2.0 through 2,99 (36%) 
3.. 1.0 through 1.99 (3%) 4. ^,99 or less (1%) 5. 1 

34*. Xhe grade you ore presently earning in this course is: 

1. A 36%- 2. B 32% V -3. C 23% 4. D 3% 5. F 2% 

35. If employed, how many ho4rs per week? 

1. less than 16 (20%) 2. 16 through 24 (23%) - 

3. 25 through 34 (13%) 4. 35 through 40 (24%) 5. over 40 (11%) 

36. How many credit hours are you presently takingf" 

1. undet 12 (38%) 2. 12 through 15 (33%) 3. 16 through 18 (18%) 

4. over 18 (8%) 

37. Sex: 1. Female 39% 2. Male 55% 

38 ♦ Why are you taking this course? 

1. A riequiretnent for your major (637o) ' 

2. An elective for your major (13%) 

3. A reqtiireraent outside your major 

4. Afeiielective outside your liiajoi;. (7%) 

39. To what exterit have you applied yourself in this course? ' 
1/ To the maximum (24%) 2. Verjr'much (38%) 

3. Average (28%) 4. Very little (6%) 5. Not at. all (2%) 

40. Do you like this sufjject? r 
1. yes ^(70%) 2. No (21%) 

41. Do you feel you had enough background to take this course? 
1. Yes (75%) 2, No (21%) " 

42. Do you attend class regularly? 

1. yes (80%) 2. No (17%) . ■ 

• 

43. Are you: * ■ . ^ 
1.- Black American (14%) ^ 2. White American other thali (3) (46%) 

3a* Spanish 5urnamed (23%) 4» Foreign student other than . (3) (^%) ' 

5. Other (6%) ' . • ' . 

44. This'spurse is a cpurse in: 

1. ^Science or Math (55%) 2. Social Science (^6%) 

3. ^English or Language (9%) 4. Other technical fields (TVS) (3%) 

5. Other .(11%) , \ ' 

* _^he-~small percentage that is missing in some of the statements w6re 

a result of blanks* Each question had no more than two or three blanks'. 
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